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PROCESS = M£^iX£g£ J ^£L^gjlC^ =; IM^ING 

The invention concerns a process for object imaging with 
high spatial resolution capability, particularly a light- 
optical microscope imaging process, and devices for per- 
forming this type of process. 

The resolution capability of optical imaging systems is of- 
ten decisively determined by the object-side aperture of an 
objective lens and its index of refraction. Light going out 
from object can only be detected if it hits the objective 
within the acceptance angle of the objective. The higher 
the resolution capability is, the higher the space freguen- 
cies of the object structure to be imaged which can be de- 
tected. The detection of the space frequencies is described 
by the light-optical transfer function or modulation trans- 
fer function (in the following: OTF) of the optical sys- 
tems. The OTF indicates which space frequencies, from which 
the object can be constructed by means of Fourier transfor- 
mation, are retained in the optical imaging, and/or how 
parts of the space frequencies are attenuated. The resolu- 
tion capability of the optical system (e.g. a light-optical 
microscope) is determined by the range in which the OTF of 
the system does not vanish. If the OTF vanishes completely 
in sections of reciprocal space, it is impossible, without 
additional assumptions about the object structure (e.g. 
spatial limitation, positivity) , to reconstruct the corre- 
sponding space frequencies in an object image. There is 
general interest in the extension of the OTF in the largest 
possible region in reciprocal space, in order to increase 
the resolution of the optical system. 



Conventional processes for increasing the resolution capa- 
bility are particularly directed toward a suitable selec- 
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tion of the object illumination. Thus, for example, in the 
confocal microscope the object is illuminated on one side 
preferably point by point with a focused beam of light and 
simultaneously scanned, with the detection often being lim- 
ited to one small region of the object by means of a dia- 
phragm (cf. e.g. US-A 4 631 581). 

In the 4Pi microscope described in EP 0 491 289, there is 
coherent illumination and, depending on the embodiment, 
also detection on both sides of the object. In the wave 
field microscope, typically illumination is performed with 
coherent plane light waves from opposing sides (cf. e.g. 
US-A 4 621 911; F. Lanny et al . in "Bioimaging" , Vol. 1, 
1993, p. 187 et seq.; US-A 5 801 881). In the I 5 M- 
microscope, there is coherent illumination on both sides 
and coherent detection, in that the two images of the ob- 
ject are brought into interference on a locally resolving 
detector (cf. US-A 5 671 085; M. G. L. Gustafsson et al. in 
"Proceedings of SPIE", Vol. 2655, 1996, p. 62 et seq). A 
theta microscope is described by E . H. K. Stelzer et al. in 
"Opt. Commun.", vol. Ill, 1994, p. 536 et seq. and S. Lin- 
deck et al. in "Handbook of Biological Confocal Micros- 
copy", editor J. B. Pawley, Plenum Press, New York 1995, 
chapter 26, p. 417 et seq, in which light is detected from 
three sides, with illumination similar to confocal or 4Pi 
being used. Because the resolution along the optical axis 
of the illumination is particularly large for lateral de- 
tection in the object plane, one obtains a reduced focused 
volume overall. 

Using a spatially varying (e.g. sinusoidally varying) illu- 
mination in stereomicroscopic surface topography processes 
is also known. By calculating the images measured, conclu- 
sions can be drawn about the surface structure of the ob- 
ject (cf. e.g. US-A 4 525 858; R. Windecker et al. in "Op- 
tical Engineering", vol. 36, 1997, p. 3372 et seq). 
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A process for high-resolution three-dimensional imaging by 
detecting optical sections of the object, similarly to con- 
focal microscopy, is described in WO 97/31282. It is based 
on taking multiple images, each with different patterns, 
from illumination apertures and associated detection aper- 
tures. Through suitable reconstruction processes, an image 
which is equivalent to that of a confocal microscope can be 
calculated from the data picked up. This process is also 
referred to as "Aperture Correlation Microscopy" (cf. also 
R. Juskaitis et al . in "Nature", vol. 383, 1996, p. 804 et 
seq, T. Wilson et al . in "Proceedings of the SPIE", vol. 
2984, 1997, p. 21 et seq) . A process is known from WO 
98/45745 which is based on illumination with imaging of a 
diffraction grating or with two interfering laser beams 
(cf. also T. Wilson et al. in "Cell Vision", vol. 4, 1997, 
p. 231 et seq) . A similar process for laterally increasing 
the resolution capability is used in the publication of R. 
Heintzmann et al. in "Proceedings of SPIE", vol. 3568, 
1999, p. 185 et seq. 

The conventional technologies have the following disadvan- 
tages. The imaging processes are connected with a rela- 
tively large technical outlay. Thus, particularly in the 
4Pi, I 5 M, and theta microscopes, the adjustment is espe- 
cially difficult. In addition, the processes are difficult 
to realize because they can be integrated in existing mi- 
croscopic systems at great expense only. In the wave field 
microscope, it is a significant problem that the OTF has 
regions in the axial direction in which it vanishes. In ad- 
dition, the wave field microscope and/or the 4Pi microscope 
do not provide any increase in resolution in the lateral 
direction in comparison with typical epif luorescence mi- 
croscopy and/or confocal fluorescence microscopy. 

Furthermore, many processes (particularly confocal laser 
scanning, 4Pi, and theta microscopy) are connected with a 
point by point scanning of the object. This is time- 
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consuming and problematic, above all in the imaging of 
time-dependent procedures. Scanning processes require very- 
fast detectors (e.g. photomultipliers ) which, however, of- 
ten have a significantly lower detection efficiency than 
detectors with localized resolution (e.g. CCD's). In fluo- 
rescence microscopy, there is the additional problem that 
the useful illuminance is restricted by the maximum excita- 
tion rate of the pigment in the focus. This additionally 
restricts the maximum scanning speed. 

Microscopic imaging processes based on non-linear effects 
are also known. Thus, for example, in US-A-5 034 613, US-A- 
5 777 732, US-A-5 828 459, and US-A-5 796 112, so-called 
multiphoton microscopy is described. The confocal effect is 
achieved in this case by the simultaneous absorption of 
multiple photons at specific object locations. Other tech- 
niques are based on stimulated emission (cf. US-A-5 731 
588, DE-OS 44 16 558) or the depopulation of the ground 
state of fluorescence molecules by intentionally pumping 
them into the longer-lived triplet state (cf. S. W. Heil et 
al. in "Applied Physics B", vol. 60, 1995, p. 495 et seq) . 

Until now, no significant increase of the resolution capa- 
bility has been able to be achieved with the processes 
based on non-linear optical effects. This is particularly 
associated with the individual photons having to have rela- 
tively low energies and therefore large wavelengths to 
achieve multiphoton absorptions. In addition, the transfer 
efficiency at higher space frequencies is generally very 
poor, because typically only a very small part of the illu- 
mination pattern contains high space frequencies. 

The object of the invention is to indicate an improved im- 
aging process with a high resolution capability. The proc- 
ess is, in particular, to overcome the disadvantages men- 
tioned above of conventional microscopy processes, to be 
able to be realized with a simplified technical outlay, to 
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allow rapid imaging, even of time-dependent procedures, and 
to be compatible with current optical systems. The process 
according to the invention is furthermore to allow known 
microscopic processes to be expanded in such a way that the 
resolution capability is additionally increased, while 
maintaining their respective advantages. It is also the ob- 
ject of the invention to indicate an optical system for 
performing these types of improved processes. 

These objects are achieved by a process and an optical sys- 
tem with the features according to patent claims 1 or 14. 
Advantageous embodiments and applications of the invention 
arise from the dependent claims. 

The basic idea of the invention is, for obtaining an object 
image (image of an object structure) , to record at least 
two partial images of an object under different object con- 
ditions, which are implemented on the object with spatial 
patterns, with a non-linear function of the light detect- 
able from the object point on the object conditions given 
at the object point existing for each object point and the 
partial images containing different contributions of vari- 
ous space frequency components of the object structure, and 
to obtain the desired object image from the partial images 
through reconstruction of the space frequency components. 
Achieving object conditions with various spatial patterns 
to detect the various partial images has the advantage that 
virtual higher and lower frequent space frequency compo- 
nents are produced in the pattern of the object conditions 
to which the space frequency components of the object 
structure are coupled. Due to this coupling, the space fre- 
quency components of the object structure are displaced 
relative to the space frequency interval which is open for 
image detection according to the light-optic transfer func- 
tion (OTF) . The complete object image can be reconstructed 
from the partial images with a correspondingly expanded 
space frequency range. 
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Through the use of a non-linear relationship between the 
light going out from the object and the local object point 
related value of a further spatially changing dimension 
(e.g. the local irradiation or illumination intensity), the 
space frequency range effectively transferred from the sys- 
tem as a whole can be significantly expanded. Through local 
variation of the influencing variable and the recording of 
multiple partial images, an object image can be recon- 
structed whose resolution is, due to the non-linearity, 
fundamentally higher than the resolution given by the Abbe 
limit. Various possibilities can be selected according to 
the application for generating non-linear effects. Obtain- 
ing the object image from the partial images is also possi- 
ble with various types of data evaluation, depending on the 
application . 

An important feature of the invention is the setting of 
predetermined object conditions with different spatial pat- 
terns. Object conditions, upon which the detected light is 
non-linearly dependent, are set point by point on the ob- 
ject corresponding to the current pattern. According to a 
first embodiment of the invention, the setting of predeter- 
mined object conditions is the formation of a spatial pat- 
tern of at least one object condition, upon which the re- 
spective amount of light detected is nonlinearly dependent. 
According to an altered embodiment of the invention, the 
setting of predetermined object conditions comprises the 
generation of a spatial pattern of at least two different 
object conditions, with there being a dependence of the 
quantity of light detected on a multiplicative linking of 
the object conditions and a linear or a non-linear depend- 
ence of the quantity of light detected on each of the ob- 
ject conditions. In general, a multilinear dependence of 
the quantity of light detected (e.g. the detected light in- 
tensity or light phase) is referred to. 



The number of partial images depends on the number of space 
frequency components measurable during the image recon- 
struction and to be considered, depending on the applica- 
tion, in the pattern of the light sent out from the object. 
This number is particularly dependent on the object condi- 
tions used to introduce the nonlinearity and on the quality 
of the imaging process realized. If the number of space 
frequency components mentioned is Z, then, as a rule, at 
least Z partial images are to be recorded. However, depend- 
ing on the case, it can also be sufficient to record fewer 
partial images if sufficient information for reconstruction 
of the object image is present. The number of partial im- 
ages is permanently set or set automatically depending on 
the quality of the object image obtained and/or manually by 
the user of the optical system. 

The process according to the invention particularly com- 
prises the following steps: (a) adjustment of the condi- 
tions obtaining in the object which are able to influence 
the light going out from an object point in such a way that 
a non-linear dependence of the light intensity detected 
from an object point on the value of a spatial pattern con- 
tained in at least one object condition is produced in at 
least one detectable value or a linear dependence to one 
value at a time of the light intensity detected from this 
object point on the values of at least two spatial patterns 
is produced, (b) recording of at least one single image un- 
der these object conditions, (c) changing the object condi- 
tions in such a way that different space frequency compo- 
nents of the object formed by the recording process change 
in their amplitude and/or phase relationship to one an- 
other, (d) recording of at least one further single image 
under object conditions changed each time according to (c) , 
and (e) evaluation of the measured images, in that the ob- 
ject conditions emphasized differently in the individual 
images are used to obtain information about the object, as- 
sociated with space frequencies of the object, which was 



not accessible through simple imaging with the recording 
process . 



An optical system according to the invention for object im- 
aging is particularly characterized by a pattern generator, 
which is set up for achieving and adjusting predetermined 
spatial patterns of object conditions on which the light 
detected from an object is nonlinearly dependent, and an 
image generator for reconstruction of the object image from 
the partial images detected. 

The invention has the following advantages. The obtaining 
of object images can be realized relatively easily. The ad- 
justment of the optical system is restricted to a minimum 
outlay for adjustment. The invention can be implemented by 
fitting existing imaging systems. 

It is particularly advantageous that high space frequencies 
which are possibly strongly suppressed in imaging objec- 
tives can now be detected more efficiently due to the dis- 
placement in the frequency space. In addition to the lat- 
eral increase in resolution, there is also an axial in- 
crease in resolution and the capability of discriminating 
planes which are perpendicular to the optical axis in the 
axial direction. The invention thus provides advantageous 
usages such as confocal microscopy. With utilization of the 
non-linear dependency of the quantity of light detected on 
the object conditions, the possibility of a significant in- 
crease in resolution in the axial direction also results. 

The invention can be advantageously used in combination 
with typical imaging processes, particularly microscopy 
processes. This particularly concerns the above-mentioned 
techniques and absorption microscopy, reflection micros- 
copy, the locally resolved imaging of fluorescence life- 
times (so-called "fluorescence lifetime imaging"), mul- 
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tiphoton microscopy, interference microscopy, confocal mi- 
croscopy, etc. . 

The imaging process according to the invention has a high 
image recording speed. The imaging can, for example, occur 
with a CCD camera at all object points in the image plane 
simultaneously and therefore can be significantly faster 
than scanning processes. 

The invention can be realized using greatly differing non- 
linear effects. For example, in a fluorescence microscope, 
illumination can occur with an intensity such that fluores- 
cence pigments in the object are saturated. This also al- 
lows various pigments or pigments in various environments 
(e.g. in various binding states), which can otherwise be 
differentiated only poorly, to be discriminated on the ba- 
sis of differing non-linear characteristics (saturation 
characteristics) . 

Further advantages and characteristics of the invention 
will be obvious in the following from the description of 
the attached drawings . 

Fig. 1 shows an illustration of object illumination in re- 
ciprocal space with sinusoidal illumination at low 
intensity, 

Fig. 2 shows an illustration of object illumination in re- 
ciprocal space with a non-linearly distorted exci- 
tation pattern, 

Fig. 3 shows a block diagram of an optical system accord- 
ing to the invention, 



Fig. 4 



shows characteristics of an optical system accord- 
ing to a first embodiment of the invention, 
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Fig. 5 shows characteristics of an optical system accord- 
ing to a further embodiment of the invention, 

Figs. 6 and 7 show simulation results for illustration of a 
process according to the invention, 

Fig. 8 shows a representation of a curve for illustration 
of the lateral resolution capability, 

Fig. 9 shows a representation of a curve of the effective 
total OTF of an optical system according to the in- 
vention (with reconstruction) , and 

Fig. 10 shows examples of object images. 

The invention is first described in the following with ref- 
erence to the theoretical foundations and then explained 
with reference to various examples. The invention is not 
restricted to the exemplary embodiments given. Altered em- 
bodiments under correspondingly varied object conditions 
can be realized depending on the application, particularly 
within the framework of the following statement of the con- 
cept . 

The object or sections of the object to be detected during 
optical imaging are generally referred to in the following 
as "object". Objects are, in particular, all types of bio- 
logical or synthetic samples which are examined with typi- 
cal imaging processes and localized resolution analysis 
processes, particularly microscopy and spectroscopy proc- 
esses. Applications result, for example, in biology, medi- 
cine, chemistry, semiconductor technology, single molecule 
spectroscopy, and similar fields. The object can be solid, 
liquid, or gaseous. 

"Object conditions" are generally understood to mean all 
parameters and/or conditions at the location of the object 
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with which one or more characteristics of the light going 
out from the object can be influenced. These characteris- 
tics particularly include the intensity, the polarization 
state, the phase, the color, the pulse shape, the pulse 
length, the degree of coherence, the photon correlation, 
and similar characteristics. Object conditions can comprise 
inherent physical or chemical characteristics of the ob- 
ject, such as a specific material composition, a tempera- 
ture distribution, or a pressure distribution, or exter- 
nally applied parameters, such as the illumination inten- 
sity on the object surface or in the object. 

The implementation of the object conditions with a spatial 
pattern means that the object conditions can be described 
with a specific position dependency. The pattern can be 
characterized by a structure (e.g. a point or line pattern) 
or can also be structureless (the same object conditions 
apply for all points on the object) . The recording of par- 
tial images under varying object conditions means that, be- 
tween the exposures, the pattern itself is changed (e.g. 
with a DMD reflector, see below) , the position and/or ori- 
entation of the pattern relative to the sample is changed 
(e.g. with a displaceable diffraction grating, see below), 
and/or an intensity characteristic of the pattern (e.g. 
with a variation of the intensity of the object illumina- 
tion, see below) is changed. 

A "non-linear dependence" of the light going out from the 
object and/or detected with a detector is given if its 
light intensity of the location of the light emission (or 
scattering or similar activity) does not measurably follow 
a simple linear model of the current object condition. In a 
development of functions, e.g. Taylor expansion (see be- 
low), of the detected light, terms of higher orders occur. 
According to the embodiments of the invention mentioned 
above, a non-linear dependence of the light intensity can 
be given by one object condition at a time or a linear de- 
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pendence of the light intensity can be given by multiple 
object conditions. In the latter case, mixed terms arise in 
the development of functions which allow the expansion de- 
scribed below of the detectable object space frequencies. 

The "detected light intensity", which is the light inten- 
sity measured by the detector, can, depending on the appli- 
cation, deviate from the average light intensity obtaining 
at the location of the detector according to the function- 
ality of the detector, if, for example, the detection is 
time modulated or a raw detector signal is correlated with 
other signals (e.g. through lock-in technology). 

A "partial image" or "individual image" is generally under- 
stood to mean image data which are recorded with an imaging 
light-optical process in its widest sense. This can be a 
single data point, or multiple data points or data point 
regions recorded at one or various object points in one, 
two, three, or more dimensions. The alteration of object 
conditions according to the invention during the recording 
of various partial images can be provided for an alteration 
or modulation for each data point, for sections or groups 
of data points, or for entire two- or three-dimensional im- 
ages or even time series. 

"Detectable space frequency components" are generally un- 
derstood to mean the components of the frequency space of 
the Fourier transforms of the objects which are detectable 
in principle with the respective imaging processes used. 

The invention allows not only an object image with in- 
creased resolution capability, but also the obtaining of 
"information about the object". This is particularly under- 
stood to include the spatial distribution of one or more 
characteristics of the object or other parameters, such as 
the position in space of a partial object known by its 
structure or the composition of the object. 
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Basic principles of image acquisition 

Image recording is described in the following with refer- 
ence to the example of fluorescence microscopy. In fluores- 
cence microscopy, objects which are marked with fluores- 
cence pigments or which fluoresce independently are imaged. 
Depending on the object structure and/or marking technique, 
marking pigments collect, for example, in specific sections 
(e.g. in the cell nucleus of a biological cell). To acquire 
the image, the object is irradiated with a suitable excita- 
tion wavelength and the emitted fluorescence radiation is 
detected. Fluorescence pigments emit with an intensity 
which is proportional at a first approximation to the in- 
tensity of the light irradiated at the location of the pig- 
ments. In contrast to absorption microscopy, reflection mi- 
croscopy, or even phase contrast microscopy, the emissions 
generally occur incoherently to one another. Assuming a 
proportionality between the fluorescence intensity emitted 
at an object point to the light intensity of the excitation 
light irradiated there, a detected image I m (x) (converted 
back into object space coordinates x) can be described as 
follows. The position dependent illumination intensity 
(Bel(x)) is multiplied by the pigment concentration Ob j (x) 
present at the respective object point (object structure) 
and the result folded with the point spread function (PSF) 
of the imaging system (cf . equation (1) ) . 

I m (x) = PSF(x) <8> (Bel(S) • Obj(x)) (1) 

In reciprocal space, this translates into the folding of 
the Fourier transformed illumination function F(Bel(x)) 
with the Fourier transformed object function F(Obj((x)) and 
subsequent multiplication with the light-optical transfer 
function OT F (k) (F refers to the Fourier formation here 
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and in the following, the coordinates in reciprocal space 
are indicated with k ) . Analogously to equation (1) , the 
following results: 



Generalized to other microscopy processes, Obj (x) indicates 
the respective value or the density of the characteristics 
of the object which is to be detected, and PSF (x) indi- 
cates the effective point spread function of the entire 
system (image acquisition and reconstruction) . This often 
still approximately applies even in iterative or non-linear 
reconstruction processes. 

In typical imaging systems, the range of the OTF not equal 
to the value zero, which is also referred to as the "car- 
rier", is restricted by the numeric aperture and the wave- 
length of the light to be imaged to a specific space fre- 
quency range (cf . also US-A-5 671 085) . Similarly, the Fou- 
rier transformation of the illumination function F(Bel(x) 
has the extent of its carrier restricted by the light wave- 
length and, possibly, apertures of the illumination system. 

According to the invention, it is thus provided that the 
effective range of detectable space frequencies of the ob- 
ject F(Obj(x)) ("object space frequencies") be expanded on 
the basis of the following considerations. With the intro- 
duction of a non-linear dependence of the light intensity 
detected on the object conditions, the right part of equa- 
tion (1) can be written, generalized according to the ex- 
pressions (2) and/or (3), as follows: 



F(l m (x)) = OTF(k) ' (F(Bel(x)) ® F(Obj(x))) 



PSF(x) ® I em (obj(x), b(x)) 



(2) 




(3) 
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According to the expression (2), no linear connection be- 
tween the light intensity I em 00 emitted from an object 
point and the light intensity irradiated there (contained 
in b(x)) is assumed. Rather, I e m00 is now a general func- 
tion of the value of the object structure to be detected 
and other factors b(x) , which represent the non-linear con- 
ditions. The vector arrow over b is to indicate that 
there can be multiple conditions or characteristics b±. An 
important factor b± is the light intensity Bel 00 irradi- 
ated on the location x . Other factors are mentioned below 
for exemplary purposes. According to equation (4), I em (x) is 
approximately expressed as a Taylor series with constant 
coefficients c±: 

I em (x) = c 0 + c x • Obj(x) + c 2 ■ b.OO + c 3 " Obj(x) • b x 00 
+ c 4 • ObjOO 2 ' b i00 + c 5 ' ob i00 ' b i00 2 + • - • 

+ c 6 • Obj(x) ' b^x) 3 + . . . (4) 

For simplified presentation, only one non-linear condition 
biOO is considered in equation (4) . Depending on the ap- 
plication, further conditions could be involved in the 
process of the emission of light from the respective object 
point. In this case, corresponding terms also arise in the 
development according to equation (4) , particularly mixed 
terms such as c 5b • Obj(x) • b^x) • b 2 (x) . The term after c 3 is 
precisely the expression mentioned in equation (1) if 
b x 00 = Bel(x)is assumed as the non-linear object condition. 
The Fourier transformation of the emitted light intensity 
F(l em (obj(x), b(x))) thus contains, analogously to equation (1), 
the term c 3 ■ F(Bel(x)) <8> F(obj(x)) . 

The Fourier transformation of the illumination intensity 
F(Bel(x)) can be represented as the sum of multiple Individ- 
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ual 5-functions . Depending on the current illumination pat- 
tern, parts of the Fourier transformed object function 
F(Obj(x)) are thus displaced by the folding with the Fourier 
transformed illumination function and added with corre- 
sponding weighting. This is illustrated in Fig. 1. 

Fig. 1 shows the structure of the excitation distribution 
in reciprocal space with sinusoidally distributed, low il- 
lumination intensity corresponding to a typical spatially 
patterned illumination. The arrows pointed upward indicate 
the maxima which result from the sinusoidal excitation 
(Fourier transformation of the sine function) . In addition, 
the structure of the Fourier transformations of the object 
function F(obj +1 (k)) "coupled" to the maximum k p is indi- 
cated. The Fourier transformations of the object function 
coupled to the other maxima are not indicated for reasons 
of clarity. Actually, however, Obj(k) is "coupled" to each 
virtual maximum because Obj(k) is to be folded with the vir- 
tual space frequency components in the pattern of the ob- 
ject conditions in reciprocal space. Only the central por- 
tion of emitted space frequencies (indicated as the carrier 
of the OTF) is accessible to detection. 

How the detectable range is established ("punched out") 
from the sum corresponding to the folding mentioned by the 
optical imaging (multiplication with the space frequency 
limited OTF) is illustrated as an example in Fig. 1. The 
range of detectable object space frequencies is signifi- 
cantly expanded for illumination with a specific pattern 
relative to the case of a uniform illumination. With the 
reconstruction process described below, the displaced ob- 
ject space frequencies can again be combined into a consis- 
tent image. 

According to equation (4) , in the non-linear case, terms of 
higher order in b x (x) also provide contributions to I em , 
such as the terms with the factors c 5 and/or c 6 . The Fou- 
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rier transformations of these terms are also contained in 
F(l em (obj(x), b(x))) . With b x (x) = Bel(x) , one also obtains the 
term c 5 ' [F(Bel(x)) ® F(Bel(x))] ® F(Obj(x)) in the expression 2. 
With a certain component in the image, it is now possible 
to measure space frequencies of the object which were pre- 
viously not accessible, because they could not yet be dis- 
placed, by folding with the space frequency limited func- 
tion F(Bel(x)), into the range detectable by means of OTF. 
The extent of the carrier from F(Bel(x)) <S> F(Bel(x)) can now, 
however, be correspondingly larger, with higher space fre- 
quencies thereby also displacing into the range correspond- 
ing to the OTF and thus being measurable in the image. Fur- 
ther higher orders work out correspondingly in further 
foldings with the Fourier transformations of b^x), so that 
even higher object space frequencies are detectable. In 
principle, it is possible to detect space frequencies of 
the object of any desired height and thereby to increase 
the resolution as much as desired, if corresponding coeffi- 
cients are present in the series expansion according to 
equation (4) . However, in practice, the resolution achiev- 
able during reconstruction is often restricted by the sig- 
nal-noise ratio attainable at the high object space fre- 
quencies . 

The effective occurrence of higher and lower frequency com- 
ponents of the illumination pattern in reciprocal space is 
illustrated in Fig. 2 with reference to the example of 
fluorescence microscopy. If the object is irradiated with a 
sufficiently high illumination intensity, a non-linear de- 
pendence of the fluorescence emission on the excitation in- 
tensity (saturation of the fluorescence) results and there- 
fore a pattern of excitability of fluorescence (in the fol- 
lowing: excitation pattern) of a specific pigment, which 
consists in principle of infinitely many (virtual) maxima 
in reciprocal space, whose absolute height quickly falls, 
however, as |k| increases. As explained above in the exam- 
ple of the relatively weak excitation intensity (linear 



case, Fig. 1) , the object function is coupled to each of 
the components of the illumination function. All informa- 
tion, particularly about the high-frequency local frequen- 
cies of interest of the object function, is therefore con- 
tained in a detector signal recorded as partial image I em . 
The reclamation of this information is described below in 
connection with image reconstruction. 

Fig. 2 illustrates the structure of the excitation distri- 
bution in reciprocal space for a non-linearly distorted ex- 
citation pattern. A coupled structure of the Fourier trans- 
formations of the object function (obj +2 (k)) is drawn to the 
virtual maximum n = +2 corresponding to 2k b . For practical 
purposes, Obj(k) is in turn coupled to each maximum (not 
shown for reasons of clarity) and overlapped with dis- 
placed, varyingly intensive, and phase-shifted versions of 
itself. Only the central portion of emitted space frequen- 
cies (carrier of the OTF) is accessible to detection. 

The object of optical imaging is obtaining an object image, 
i.e. the function describing the object Ob j(x) . This func- 
tion must be reconstructed from the measured partial images 
I m . The reconstruction of the object image is based on the 
factors bj(x) being extracted from the partial images I m or 
being known independently of the image acquisition. The 
differentiation according to the invention of the factors 
from the function Ob j ( x ) describing the object is per- 
formed in that the factors b±, i.e. the frequently spa- 
tially patterned object conditions, are varied. 

The variation of the object conditions can occur in various 
ways. A first possibility is to implement bj(x) as a spatial 
pattern, which is displaced on the object to record each of 
various partial or single images. Alternatively, it is also 
possible to change the strength of the pattern (contrast of 
the object conditions set on the entire object) or the 
shape of the pattern to record each of the partial images. 
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In each case, the components shown in the expansion accord- 
ing to equation (4) are different. 

The image acquisition of the process according to the in- 
vention is based on recording at least two partial images 
with different object conditions being varied, among them 
the factors b ; (x), with which the detected light intensity 
has a non-linear relationship. The reconstruction of the 
object image from the partial images is explained in the 
following . 

Reconstruction of the object image 

According to a preferred embodiment of the invention, the 
terms contained in the Taylor expansion according to equa- 
tion (4) are established by the solution of an equation 
system and thus separated from one another, if they have a 
measurable influence. The equation system, whose determina- 
tion is explained in detail below, can be determined and, 
in principle, solved at each point in the range of the car- 
rier of the OTF in reciprocal space, in spite of multipli- 
cation with the OTF. 

Through displacement in Fourier space (or through multipli- 
cation with expfiAkx) in the local space, Ak : frequency 
space displacement vector) , the individual components can 
then be combined in such a way that a high-resolution image 
results. This can, if necessary, be processed with further 
deconvolution techniques in order to further increase the 
image quality. 

As already known from US-A-5 671 085, the illumination of 
the object with a pattern made of the highest possible 
space frequencies results in an increase in resolution 
relative to typical light-optical microscopy. Through the 
utilization according to the invention of a non-linear re- 
lationship between the strength of the pattern, e.g. values 
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of specific object conditions, at an object point and the 
light intensity going out (emitted and/or diffracted) from 
this object point, it is possible to calculate an image 
with an even higher local resolution. 

An example for the formation of a pattern of object condi- 
tions is given in the excitation of fluorescence with a po- 
sition-dependent distribution of intensive excitation 
light. The non-linear dependence of the light detected by 
the detector can, for example, occur due to the saturation 
of the excitation of fluorescence pigments present in the 
object. If the excitation light has a sufficiently high in- 
tensity, one obtains a non-linear relationship between the 
irradiated and the emitted light intensity on the object 
observed (cf., for example, D. R. Sandison et al. in "Hand- 
book of Biological Confocal Microscopy", Plenum Press, New 
York and London, 2nd edition, 1995, chapter 3, pp. 47 to 
50; and R . Y . Tsien et al. in the "Handbook of Biological 
Confocal Microscopy" cited, chapter 16) . The detected light 
thus also contains information about space frequencies of 
the object which would otherwise not be accessible. How- 
ever, each image recorded in this way contains a mixture of 
components of higher space frequencies, which can then, 
however, be separated and combined into a consistent, high- 
resolution image by recording under varying conditions and 
counterbalancing multiple partial images. 

The equation system for separation of the components of the 
Taylor expansion according to equation (4) is, for example, 
determined with the following steps in the case of fluores- 
cence microscopy for illumination with a structure similar 
to a linear grating. 

The intensity distribution of the excitation light is ap- 
proximately described in this example by a sine function 
displaced into the positive range. In the ideal case, 
point-shaped maxima at k=0, k=+k b , and k=-k b result as 
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Fourier transformations (cf . Fig. 1) . These maxima have, 
depending on the degree of modulation, a specific energy 
and a specific phase angle in the complex plane, which de- 
pends on the position and/or the displacement (location) of 
the pattern of the excitation light. Through the influence 
of the non-linear dependence of the fluorescence emissions 
on the excitation intensity (saturation of the fluores- 
cence) , the pattern shown in Fig. 2 with lower and higher 
frequency components in reciprocal space results, for exam- 
ple, as the excitability pattern for a specific fluorophor 
type. 

For reconstruction of the object image, it is sufficient to 
truncate approximately at a finite space frequency value 
k max = + mk^ and to consider only maxima with smaller space 
frequencies in the calculation. 

If the excitation light pattern is displaced relative to 
the object, the respective complex phase locations of the 
individual point-shaped maxima in the Fourier space change. 
If one considers ± m excitation maxima and the maximum at 
k = 0, one therefore requires Z = 2m + 1 images recorded 
under various conditions in order to be able to separate 
the individual components of the object image through the 
microscope, which are folded (i.e. displaced) with the cur- 
rent maximum (in Fig. 2, only one component is illus- 
trated) . It can, for example, be provided that Z = 5 maxima 
are considered. The phase angle of the maxima in the fre- 
quency space of the excitation pattern moves upon displace- 
ment of the pattern proportionally to n| k b |, because a dis- 
placement in the space by Ax corresponds to a multiplica- 
tion in the frequency space with exp(ikAx) . In this case, n 
corresponds to the number of the current space frequency 
component (cf . Fig. 2) . Therefore, if various images (par- 
tial image) I n (k) = F(l n (x))of the object are recorded, each 
with the phase location of the illumination pattern (i.e. 
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the excitation pattern) displaced by a fifth of the basic 
pattern relative to one another, the following equation 
system results: 



fobj 0 




fi 0 (K)l 


Obj +1 (k) 






Obj.^k) 


— const " 


i 2 (e) 


Obj +2 (k) 






^>bj_ 2 (k), 
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1 exp(i27t / 5) exp(- ±2n / 5) exp(i47t / 5) exp(- Utz / 5) 

1 exp(i4Tt / 5) exp(- i47i / 5) exp(i87i / 5) exp(- i8rt / 5) 

1 exp(i67t / 5) exp(- ±6n / 5) exp(il27i / 5) exp(- ±12n / 5) 

1 exp(i87t / 5) exp(- i87t / 5) exp(il67t / 5) exp(- il67t / 5) 



In this equation system, Obj n (k) corresponds to the dis- 
placed complex value components of the Fourier transformed 
object (object space frequencies) belonging to the n-th 
maximum of the excitation pattern, which are then transmit- 
ted by the OTF of the imaging system. 

The solution of the equation system provides the individual 
object components which belong to the respective maximum of 
the excitation pattern. The solution can, for example, be 
performed by inverting the matrix M. Through multiplication 
of the inverse matrix (M _1 ) with the vector on the right of 
the measured intensities I n (k), the individual transmitting 
object components are determined. If more measurement data 
are present than is necessary for solving the reconstruc- 
tion task, an analogous non-quadratic or rectangular matrix 
can, for example, be drawn up. Then, for example, the proc- 
ess of the pseudo-inverse matrix is usable for the calcula- 
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tion of the solution, which allows a solution with the 
smallest proportion of errors to be determined. 

Due to the linearity of the Fourier transformation, the 
calculation is preferably performed point by point or pixel 
by pixel in real space. 

The complex value components Obj n (k) can now be displaced by 
the vector Ak in the Fourier space (or by the correspond- 
ing multiplication in real space discussed above) , so that 
the respective space frequency k ends up where it would be 
measured in a non-patterned, uniform illumination. Ak is 
therefore -nk b in this case. 

In a further step, a correction of the components Obj n (k) in 
their complex phase locations is provided, according to the 
mutual phase location § n of the frequency space excitation 
maxima in the image I n (multiplication with exp (-i<j> n ) ) . 
Subsequently, the components Obj n (k) are combined, if neces- 
sary through weighted addition, into a consistent image 
(the desired object image). In this way, an extension of 
the carrier of the entire OTF to a range significantly 
enlarged relative to the linear image and therefore an in- 
crease of the resolution capability is made possible. 

The displacement of space frequency components illustrated 
can be performed in different space directions. This can 
occur successively through varying orientation of the illu- 
mination pattern or simultaneously through illumination 
with a multidimensional structure. The resolution capabil- 
ity can be increased in one, two, or three dimensions. The 
overall transfer function can be altered still further, 
subsequently or in intermediate steps, by appropriate fil- 
ters and/or application of unfolding techniques known per 
se . 
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The reconstruction of the object image is not restricted to 
the described solution of the equation system with the ma- 
trix methods. Alternatively, for example, squaring tech- 
niques (analogous to WO 98/45745) or algebraic and/or it- 
erative reconstruction processes (maximum likeli- 
hood/expectation maximization, maximum entropy, algebraic 
reconstruction, and similar methods) could be used. 

The invention is not restricted to the non-linear excita- 
tion of fluorescence emissions. The procedure can also be 
implemented correspondingly with any desired other factors 
b± which are suitable, alone or in interaction with one an- 
other, particularly in interaction with the illumination 
intensity, for influencing the light going out from the ob- 
ject . 

Embodiments of optical systems according to the invention 

An optical system according to the invention is illustrated 
in Fig. 3. The components of a typical microscope known per 
se are indicated with dashed frames. The optical system 100 
is constructed with an illumination unit 10, at least one 
pattern generator 20, 20", 20", an illumination optic 30, 
an imaging optic 50, a detector unit 60, and an image gen- 
erator 70. The reference number 40 refers to the sample to 
be examined with the system 100. The components 10, 30, 50, 
and 60 can be provided by optical components known from op- 
tical-light microscopy and from optical measurement and 
analysis technology, e.g. spectroscopy. Depending on the 
application, the components 30 and/or 50 can be dispensed 
with or formed by a shared component. It can also be pro- 
vided that the components 20 and 30 be formed by a shared 
optical component. 

The pattern generator 20, 20 ! , and/or 20" is generally a 
device for forming object conditions with a predetermined 
spatial pattern on the object 40. Depending on the applica- 



tion, the pattern generator 20 can be a mask with a spe- 
cific one- or two-dimensional transmission characteristic 
corresponding to the desired pattern. The mask can particu- 
larly be formed by a diffraction grating (cf. Fig. 4) (or 
phase grating) or a matrix assembly made from individually 
drivable reflector or transmission pixels. In the latter 
case, DMD units ("digital mirror device") and/or LCD matrix 
assemblies are used. The pattern generator can also com- 
prise a mirror assembly for generating an interference pat- 
tern (cf. Fig. 5) or a device for direct physical or chemi- 
cal influencing of the object 40 (e.g. a heating device or 
an ultrasound transmitter) . In contrast to the component 20 
in Fig. 3, the pattern generator can also be provided be- 
tween the illumination optic 30 and the object 40 (compo- 
nent 20") or directly on the object 40 (component 20'). 

The image generator contains a device for reconstruction of 
the object image corresponding to the principles explained 
above. A specially designed circuit or an appropriately 
programmed computer can be used as the image generator. The 
image generator can contain additional memory, control, 
and/or display components. 

Fig. 4 shows features of an optical system according to the 
invention using the example of an epif luorescence micro- 
scope 100. The illumination device 10 is formed by an in- 
tensive light source. Because high light intensities are 
necessary for the utilization of non-linear effects, a 
pulsed light source, e.g. a pulse laser or a flash lamp, is 
preferably used. The illumination device can, however, also 
be formed by a high-pressure vapor lamp (e.g. mercury vapor 
lamp) . An adjustable and possibly rotatable and/or movable 
diffraction grating 22, which is located corresponding to 
position 21 of the image field screen in a conjugated ob- 
ject plane, is provided as the pattern generator 20 (mask) 
as an example. The diffraction grating 22 is a transmission 
grating with a grating interval of, for example, 30 urn. The 
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diffraction grating 22 is positioned on an adjustment drive 
(not shown) . 

The illumination optic 30 has an excitation filter 31, a 
dichroitic mirror 32 for coupling the excitation light into 
a microscope column and objective lenses 33. At the loca- 
tion of the object 40, an image of the diffraction grating 
22 is formed in the corresponding focal plane as illumina- 
tion for the sample to be examined. The imaging lens 50 is 
formed in turn by the objective lenses 33, an emission fil- 
ter 51, and an optionally provided optic 52 for image 
enlargement. The detector device 60 is a CCD detector, by 
which data is transmitted to the image generator (not 
shown) . 

In the assembly according to Fig. 4, the diffraction grat- 
ing 22 can be replaced by a DMD device or an LCD matrix as- 
sembly which is positioned in the light path between the 
illumination device 10 and the object 40. In this case, an 
additional reduction optic is provided between the compo- 
nents 20 and 40. A DMD device comprises, for example, ap- 
proximately 400 • 600 reflector elements with a pixel size 
of approximately 17*17 um 2 . 

For the recording according to the invention of multiple 
partial images with different phase locations, the diffrac- 
tion grating 22 is displaced in small steps relative to the 
object 40. The step width depends on the structure dimen- 
sions of the mask and the number of partial images to be 
recorded and is, for example, 30/7 um for a 30 um struc- 
tural dimension and 7 partial images. Alternatively, a dis- 
placement of the object 40 can be provided for a fixed dif- 
fraction grating 22, with this, however, reguiring addi- 
tional steps of image correction during the reconstruction 
of the object image. Alternatively, it is also possible to 
influence the phase of the various diffraction maxima di- 
rectly through suitable optical elements. The minimum num- 
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ber of exposures of partial images necessary for the recon- 
struction of the complete image results from the number of 
unknowns of the associated equation system (see above) . At 
least two partial image exposures are intended. 

In order to increase the resolution in all spatial direc- 
tions, the object 40 is illuminated successively with pat- 
terns at various angles or with a mask, such as with the 
DMD or LCD device with a two-dimensional pattern which pro- 
duces the diffraction maxima in multiple directions of the 
plane, in various phase locations in each dimension. 

By providing a series of focuses, one can obtain still more 
information about the axial structure of the object and 
thereby derive three-dimensional object images. This is 
simplified even more, on one hand, by the incoherent light 
source and, on the other hand, by the presence of the zero 
point diffraction order of the grating. A further increase 
in resolution can be achieved by rotating the object under 
the optical system around an axis perpendicular to the op- 
tical axis. 

The object 4 0 is illuminated and/or excited with instanta- 
neous intensities in such a way that the pigments in the 
sample become saturated, so that the desired non-linear ef- 
fect for increasing the resolution capability results. The 
components of the overlapping individual orders sought can 
be calculated from the images for various phase locations 
of the excitation structure. It is also possible to recon- 
struct high-resolution images from exposures of partial im- 
ages with varying illumination intensity. If one suppresses 
the zero point diffraction order of the diffraction grating 
21 (e.g. by masking), one thereby advantageously increases 
the degree of modulation of the illumination function and 
therefore the relative intensity in higher orders of exci- 
tation. In addition, the energy can be displaced into 
higher space frequency ranges. 
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In the altered design of an epif luorescence microscope 100 
according to Fig. 5, the sample (the object) 40 is illumi- 
nated with laser light. The light source 10 is preferably a 
pulse laser (e.g. with an optical-parametric oscillator 
which is pumped with a frequency-tripled NdYAG laser, or 
with a Ti-sapphire laser) , but can also be formed by an- 
other sufficiently intensive light source. The pattern gen- 
erator 20 is formed by a group of flat mirrors 23-27, which 
are set up for the purpose of dispersing the excitation 
light from the light source 10 onto various beam paths, 
which meet the object 40 from various directions. The exci- 
tation light is directed onto the object from two opposing 
sides with the semitransparent mirrors 23 and the com- 
pletely reflecting mirrors 25-27. Optionally, the second 
semitransparent mirror 24 can be provided in order to form 
a third excitation light path to the object 40. Three exci- 
tation light beams which interfere with one another result, 
which allows a use of the microscope 100 in extremely high- 
resolution 3-D microscopy. For two-dimensional applica- 
tions, the mirror 24 can be dispensed with. The beams in- 
terfere over a range which is of the magnitude of the co- 
herence length of the light source 10. 

To change the object conditions (interference pattern at 
the object 40) to record various partial images, at least 
two mirrors are positioned movably. For example, it is pro- 
vided that the mirrors 24 and 25 are displaceable for 
changing of the interference pattern. Alternatively, at 
least one electrooptical element for changing the phase lo- 
cation of the illumination light is provided in one of the 
partial light paths for changing the object conditions. 

The illumination optic 30 is not shown in Fig. 5 for rea- 
sons of clarity, but can, if necessary, be left out anyway 
depending on the structural shape. The imaging optic 50 
comprises the objective lenses 53, the emission filter for 
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absorption of the excitation light 51, and optionally a op- 
tic 52 for image enlargement. A CCD detector 60 is again 
provided as the detector. 

In order to obtain good axial discrimination, the excita- 
tion light can also fall on the object 40 simultaneously 
from one or more directions through the objective (not 
shown) and/or from the side away from the objective, which 
is in the differential region of the excitation light beams 
(crosshatched region) . The additional increase in resolu- 
tion achievable through nonlinearities can in turn be 
achieved through the use of correspondingly stronger lasers 
and/or pulse lasers with high instantaneous intensities. 
The usage of other intensive light sources (e.g. flash 
light) is possible and sometimes advantageous. 

To perform the process according to the invention, multiple 
partial images are recorded, each with differing interfer- 
ence patterns on the object 40, and processed according to 
the principles for obtaining the object image explained 
above . 

The exemplary embodiments described are based on the usage 
of the non-linear dependence of the light detected on the 
intensity of the excitation light due to saturation of 
fluorescence pigments. Alternative non-linear effects are 
given by the saturation of the absorption of excitation 
light under intensive illumination, the dependence of the 
phase of the emitted or scattered light on the illumination 
intensity present in the object, which converts in the de- 
tector (e.g. the interference) or before it into a non- 
linear intensity dependence, SHG or THG processes, a de- 
pendence of the light characteristics of the Raman scatter- 
ing on the value of one or more object conditions, tempo- 
rally coherent effects (e.g. Rabi oscillations) on atoms or 
molecules in the object, CARS processes, multiphoton ab- 
sorptions, stimulated emissions in the object, the popula- 
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tion of longer-lived excitation states or chemically al- 
tered states in the fluorophors before or during the illu- 
mination, radiation-free energy transfer processes, and/or 
physical or chemical object conditions. 

Particularly for the use of temporally coherent effects 
(Rabi oscillations) on atoms or molecules or fluorophors in 
the object (in solution, in solid bodies, in gases, or un- 
der vacuum conditions) , illumination devices with extremely 
short pulse lengths (e.g. < 100 fs) are preferably used. If 
the non-linear effect is based on stimulated emission, this 
is induced simultaneously or in temporal sequence. The 
stimulated emission can be induced at the same wavelength 
as that of the excitation light or at other wavelengths, 
e.g. at a typical fluorescence wavelength. The usage of en- 
ergy transfer processes means that energy of the excitation 
radiation is transmitted with or without radiation by 
fluorophors onto neighboring fluorophor molecules and 
thereby a multilinear dependence of the emitted light in- 
tensity on the intensity irradiated onto the neighboring 
location arises. 

The physical or chemical changes of the object conditions 
particularly include the usage of the non-linear dependence 
of the light going out from the object points on a spa- 
tially inhomogeneous electric or magnetic field or on the 
pressure, shear forces, or mechanical tension relationships 
obtaining at the object point. A temperature gradient 
formed on the object can also be provided corresponding to 
a specific pattern, which provides the desired multilinear 
dependence of the light going out from the object point on 
the respective temperature obtaining. A multilinear depend- 
ence of the light going out from the object point on the 
chemical conditions obtaining there (e.g. pH value) can 
also be used. In addition, an irradiation of the object 
with radio waves, microwaves, infrared light, x-rays, or 
even sound waves or ultrasound waves can be used. 
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The pattern generator is appropriately adjusted for reali- 
zation of the effects mentioned. For example, the pattern 
generator can comprise an additional irradiation device 
whose emission is focused on the object. 

Figs. 6 and 7 illustrate simulation results for the use of 
a fluorescence microscope according to Fig. 4. The light 
intensity is represented here as blackening. For reasons of 
print technology, the image quality is restricted. For bet- 
ter visualization of the illumination, a constant back- 
ground fluorescence is assumed in the object (Figs. 6a, 
7a). Fig. 6a shows the simulated object, whose illumination 
with the processes described and imaging with an epifluo- 
rescence microscope is simulated. The partial images b-h 
represent simulations of partial images, each taken with 
different phases of the illuminating line pattern. Fig. 6i 
shows an example in which the direction of the illuminating 
pattern is also changed. The excitation intensity was lar- 
ger by a factor of 5 than the saturation intensity in this 
simulation. The maximum expected photon count was 560 pho- 
tons/pixel in the individual images. Fig. 7 shows the asso- 
ciated reconstruction results. Fig. 7a repeats the original 
image of the simulation. After filtering with the point 
spread function of a simulated microscope and a Poisson 
distributed increase of noise (maximum = 5 60 photons) , the 
image from Fig. 7b results. The reconstruction according to 
the invention from partial images, which was simulated with 
illumination patterns under 3 rotational angles analogously 
to the Figs. 6b to 6h, is shown in Fig. 7c. In this case, 
no amplification of higher space frequencies is performed. 
If the high frequency amplification intrinsic to the system 
also occurs, the image according to Fig. 7e results from 
Fig. 7c. The usage of a corresponding high-frequency ampli- 
fication with the (conventional) image according to Fig. 7b 
would merely result in an image according to Fig. 7d. The 
comparison of the images of Fig. 7e and Fig. 7d shows the 
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superiority of the process according to the invention of 
reconstruction of higher space frequencies from the re- 
cording of multiple partial images. Fig. 7f illustrates the 
associated simulated carriers of the OTF achieved with the 
process for a number of maxima 1=1 considered. 

Fig. 8 illustrates the improvement of the resolution capa- 
bility with the process according to the invention. The in- 
tensity on a reference line along the two perpendicular 
columns in the point matrix (above left in the original im- 
age) is illustrated in the Figs. 7d and 7e. The solid line 
corresponds to the result of the process according to the 
invention. The single points are clearly recognizable as 
maxima. With the typical process (epif luorescence followed 
by high frequency amplification) , only the first point 
(partially) and a maximum between the two lowermost points 
are recognizable. An improvement of the resolution capabil- 
ity by a factor of more than 3 results for the simulated 
imaging of a point. 

Fig. 9 shows a lateral section through the simulated effec- 
tive optical transfer function of the overall system ac- 
cording to Fig. 4. The grating interval of the diffraction 
grating is selected here in such a way that only the dif- 
fraction orders 0, +1, and -1 of the diffraction grating 
can be transmitted by the objective. Through the partial 
saturation of the pigments involved, a non-linear relation- 
ship between the excitation intensity and the probability 
of excitation of a pigment molecule at one point in the ob- 
ject space results. This spatially varying excitation prob- 
ability is also referred to as the excitation pattern. If 
one assumes that the excitation probability for a specific 
pigment molecule is a function of the excitation intensity, 
then a nonlinearity of this function leads to spatially 
higher harmonics of the excitation pattern also occurring 
in the emission pattern. Maxima in reciprocal space which 
lie beyond the space frequency limit given by the Abbe 
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limit can then occur in the excitation pattern. The space 
frequency limited imaging of the multiplication of the pig- 
ment distribution with the excitation pattern now contains 
components analogous to a linear excitation with a pattern 
containing higher space frequencies. 

In Fig. 9, it can be seen in detail that the transfer func- 
tion in a typical image with a microscope objective (with 
subsequent application of high frequency amplification) is 
relatively narrow, corresponding to the solid line, while 
in contrast the transfer function for the use of saturated 
illumination (with high frequency amplification) is sig- 
nificantly expanded (shown as a dashed line) . 

Fig. 10 shows a simulated application of the process ac- 
cording to the invention on a sectional image of the cell 
nucleus of an embryonic bovine cell recorded by means of 
electron microscopy. Fig. 10a illustrates the inverted 
electron microscope section near the nuclear membrane with 
the nuclear matrix. The simulated epif luorescence micros- 
copy exposure with unfolding results in the typical image 
shown in Fig. 10b. With use of the process according to the 
invention, the image shown in Fig. 10c results. The image 
taken and evaluated with the method of saturated lateral 
modulation and subsequently unfolded (maximum: 560 photons 
in the single image) is significantly improved compared to 
the typical image and comparable with the original electron 
microscope image. 

The features of the invention disclosed in the preceding 
description, the drawings, and the claims can be signifi- 
cant for the realization of the invention in its various 
embodiments individually and in any desired combination. 
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CLAIMS (as originally filed and published) 

1. Process for obtaining an object image of at least one 
object (40), wherein at least two partial images of 
the object (40) are taken under differing object con- 
ditions which are formed on the object with spatial 
patterns, wherein a non-linear dependence of the light 
detectable from the object point on the object condi- 
tions obtaining at the object point exists and the 
partial images contain different contributions of 
various space frequency components of the object 
structure, and the desired object image is determined 
from the partial images by reconstruction of the space 
frequency components. 

2. Process according to claim 1, wherein spatial patterns 
of at least one object condition are formed, for each 
of which the non-linear dependence of the detected 
light emitted from the object point exists. 

3. Process according to claim 1, wherein spatial patterns 
are formed by at least two object conditions, for 
which a dependence of the detected light on a multi- 
plicative linking of the object characteristics and a 
linear or a non-linear dependence of the detected 
light on each of the object conditions exists. 

4. Process according to one of the preceding claims, 
wherein the spatial pattern is given by a pattern of 
an illumination intensity on the object (40) and the 
object (40) is illuminated with the pattern of the il- 
lumination intensity in such a way that a non-linear 
dependence of the light intensity, detected at a de- 
tector device (60), coming out from an object point to 
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the illumination intensity obtaining at this object 
point exists. 

5. Process according to one of the preceding claims, 
wherein the non-linear dependence of the detected 
light is formed by a saturation of fluorescence light 
of fluorophors under intensive illumination, a satura- 
tion of the absorption of illumination light under in- 
tensive illumination, a dependence of the phase of the 
emitted or scattered light on the illumination inten- 
sity present in the object, SHG or THG processes, a 
dependence of the light characteristics of the Raman 
scattering on the value of one or more object charac- 
teristics, temporally coherent effects on atoms or 
molecules in the object (40) , multiphoton absorption, 
CARS processes, stimulated emission, population of 
longer-lived states or chemically altered states, ra- 
diative or radiation-free energy transfer processes of 
fluorophors to neighboring fluorophors, nonhomogeneous 
electric or magnetic fields obtaining at the object 
point, pressures, shear forces, or mechanical tension 
relationships obtaining at the object point, tempera- 
tures obtaining at the object point, chemical rela- 
tionships obtaining at the object point, and/or addi- 
tional object irradiations with electromagnetic rays 
or sound waves. 

6. Process according to one of the preceding claims, 
wherein the spatial pattern of an object condition in 
reciprocal space can be described or approximately de- 
scribed by a number of points which are distributed in 
one, two, or three dimensions, or is formed spatially 
periodically or approximately periodically in one or 
more dimensions in the location space. 

7. Process according to one of the preceding claims, 
wherein the object and the spatial pattern are dis- 



placed in one or more directions relative to one an- 
other to achieve various object conditions. 

Process according to claim 7, wherein the pattern is 
generated by a mask or by interference and a displace- 
ment of the mask is achieved by displacement of the 
phase of various diffraction maxima. 

Process according to one of the preceding claims, 
wherein the object conditions are changed according to 
a predetermined temporal structure and the partial im- 
ages are taken at various times. 

Process according to claim 9, wherein the illumination 
intensity is varied to generate different object con- 
ditions . 

Process according to one of the preceding claims, 
wherein the reconstruction of the object image from 
the partial images is performed by solving an equation 
system, taking into account the non-linear dependen- 
cies, or by an iterative procedure. 

Process according to one of the preceding claims, 
wherein the position of the object or one or more par- 
tial objects of the object (40) is established. 

Process according to one of the preceding claims, 
wherein the reconstruction of the object image is per- 
formed taking into consideration a previously known 
structure of the object (40) or of parts of the object 
(40) . 

Optical imaging system (100) having an illumination 
device (10) and a detector device (60), which are set 
up for illuminating an object (40) and recording an 
image of the object (40) or of parts of the object 
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(40) , characterized by at least one pattern generator 
(20, 20', 20") for generating at least one changeable 
spatial pattern of object conditions on the object 
(40), with the illumination device (10) and/or the 
pattern generator (20, 20', 20") being set up for 
generating object conditions on which the light de- 
tectable by the detector device (60) is nonlinearly 
dependent, and an image generator (70) for reconstruc- 
tion of an object image from partial images which were 
recorded with the detector device (60) . 

15. Optical system according to claim 14, wherein the pat- 
tern generator (20, 20', 20") comprises a mask with 
which a spatial pattern of an illumination intensity 
can be formed on the object (40) . 

16. Optical system according to claim 15, wherein the mask 
comprises a multidimensional diffraction grating (22) , 
a phase grating, a DMD device, or an LCD matrix. 

17. Device according to claim 15 or 16, wherein the mask 
and the sample (40) are positioned so they are movable 
and/or rotatable relative to one another. 

18. Optical system according to claim 14, wherein the pat- 
tern generator (20, 20', 20") comprises a mirror as- 
sembly (23-27) which is set up for generating of an 
interference pattern on the object (40) . 

19. Optical system according to claim 14, wherein the pat- 
tern generator (20, 20', 20") comprises a device for 
achieving predetermined physical or chemical condi- 
tions on the object (40) corresponding to the spatial 
pattern. 

20. Optical system according to claim 14, wherein an ad- 
justment device for displacement of the object (40) in 
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the spatial pattern of the object conditions is pro- 
vided. 

21. Optical system according to one of the claims 14 to 

20, wherein the illumination device (10) comprises a 
flash lamp, a laser, or a high-pressure lamp. 

22. Optical system according to one of the claims 14 to 

21, wherein an illumination optic (30) and/or an imag- 
ing optic (50) are provided. 

23. Usage of a process or an optical system according to 
one of the preceding claims in combination with typi- 
cal optical microscopy processes, particularly in com- 
bination with standard far field microscopy, epifluo- 
rescence microscopy, confocal microscopy, 4Pi micros- 
copy, theta microscopy, near field microscopy, micro- 
scopic I 2 M, I 3 M, and I 5 M processes, STED processes, 
multiphoton microscopy, CARS processes, and SHG or THG 
microscopy. 
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